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ABSTRACT ■ ' 

Achievement a^^seSsment has recently become an issue 
of major public concern. Concurrent with demands which have placed 
increased reliance on measurement and assessment have been criticisms 
of present testing practices, '^he effects of sociocul tural and 
motivation variables on ?v<J'hievemen* patterns of 7, 000 Illinois s::hool 
children were in vesti gaffed . Achievement, conceptualized as the 
students' sense of competence (evaluation anxiety and achievement 
a^.tribut ions) and motivp t^. on aoals, was 'assessed through the use of . 
standardized testing instruments, Pesults indicated that: (1) 
sociocultural background dfrectlv affects mo+ivation and performance; 
(2) motivational -effects serve - to reinforce or enhance the'effects of 
sociocultural background on performance: and (3) both objective 
performance and the interpretation of that performance affect 
motivatictfi. (Author/HLH) 
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Soclocultural and Motivational Considerations In the 
Asaesament of Educational Achievement: A 
Theoretical OvervievT 
Martin L. Maehr 

This Is an initial v^ort of kn irttensive and massive study of the 

soclocultural origins o/ motivation and achievement through the school years./ 

By massive, I refer /o' the fact that the achievement patterns of approximately 

7,000 sTchool childrren across the Stat-e of Illinois, are sampled each year. By 

intensive 1^ refifer to the fact that not only is a wide variety of information 

accumulated /see Table 1> , but .that patterns and associations are subsequently 
• / 

/ ^ 

examined both experimentally as well as ethnographically . This symposium' 
focusey primarily on oj^ie facet of this larger project, namely with the effects 
of aociocultural anc| motivational variables in one very critical school achieve- 
ment situation: the achievement testing situation. The purpose of this paper 

t to set forth ^he general and theoretical background for the answers that 
follow. 

Insert Table 1 about here 



General Background and Rationale 
In the last several years increasing attention has been devoted to 
assessment of school achievement ► As a matter of fact, a national debate (see 
for example, Wirtz, et al., 1977) has arisen over the nature, meaning and causes 
of a decline in >achievement test scores. Parallel and clearly related to thia, 
the suggestion is made that Children should demonst^rate "mlnlmimi competencies" 
for graduation and/or promotion from on^ grade to tlie next. AU in all, the 
assessment of achievement has become an issue of major public concern. 



Concurrent with demands, which, have placed increased reliance on measure-* 
ment and assessment, have been vigorous criticisms of present testing practices 
<Ho.uts, 1977; National Schc^ol Boards Association, 1977; Quinto & McKenna, 1977) » 
Although, public controversy over testing is not new (Cronbach, 1975), the 
criticism in recent' years ha,s becom^ever harsher. Moreover, ^he debates in 
the pQst decade or so have not been limited to academic.s and journalists." 
State and* national lejgislatures , the general .public, and the courts have aQ.1* 
been^ Involved. 'Especially when considering the performance of minority group 
children, the debates have revolved around the biased nature of the tests 
their unfairness to certain groups, as well as their general inadequacy to 
assess school achievement appropriately ^ This symposium is especially concerned 
with such testing bias. It is concerned with ^a special form of test bias , 
that has generally ajpne unrecognized in this cdpntry's testing movement: 
motivational bias. ^ . . - 

There 1^ increasing evidence that mativational factors may be 
a very important source of test bias (Hill, 1977; in press). Moreovef, 
recent, renev^ed emphasis on achievement testing and the introduction oE « 
•new evaj.uation programs, such as minimal competency testing,' are 
the very elements that are likely to make motivational test bias an even 
stronger fax:tor in the assessment of student^s achievement. As the\:onse- 
quences of doing poorly or failing a test become more serious (not being 
promoted, not graduating, etc:.) and more public, test pressure and negative 
motivational-4ynamics should become stronger. Of particular importance is the 
strong possibility that such test bias is likely to be slrongosl for students 
v;ho do not penform well on : standardized tests as now p4ven and who suffer the 



the consequences of test failure the most: the anxious > often low-income/ 
minority students. All of this leads to the n^cessilfy of giving further and 

• intensive consideration to the topic of this syposium. 

Theoretical Framework , 
Granted that it may well be worth examining how motivation mediates teat 

performance, particularly in the case of minority group students, precisely 

how does this occur? What 'motivational variables are critical? What is the 

theoretipal rationale which guides the search? 

In general, the theoretical framework of the project involves linkages 

among three classes of variables, as outlined in Figure 1. The essential 

foous of the project, however, is on intervening motivational variables, ^ 

t 

termed here "achieving orientations . 'The overall guiding hypothesis .is that 

* ^uch internalized psychological processes play an important mediational role * 
in • determining the effects of sociocultural backgr^Kind and achievement context 
on achievement behavior (cf. Maehr & Nicholls, inpress^. Moreover, this 
mediator role follows a developmental pattern. Not only do achieving orientations 
per 5e change with dge, th^y also increase in Importance with age. Briefly 

and simpJLy put, in the co.urs^^of schooling an individual develops a sense of 
competence and acquires certain achievement goals . These two factors play 
an increasing mediational role in determining achievement through tlie. school 
years. 1*hey are likewise of importance in that very special, very focused, 
achievement situation: the .standardized test . Simply put, children who l^ck v 
a sense of comptence or do not share the achiovoiiient goals of the classroom 
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are unljlkely .to demonstrate what thej^know on a standard achievement .test. 
Both will exhibit inappropriate test-taking behavior in the standardized t>st- 
taking situation which is currently relevant . Because this situation essentially 
turns off ^nd/or inhibits the best performance o^f these students, we speak 
directly of a motivational bias > It is q^uite possibly ever bit as serious 
as the much more commonly recognized bias in substance or test content. 

While this is *th^ essential theoretical thrust pf the' project, it is 
necessary to clarify further, and in more "operational terms, how "achieving 
orientations" are conceptualized. As already indicated, two categories of 
achieving orientations are proposed: the one termed "sense of competence" 
and the other "achievement goals." A comment about each of these is. in order. ^ 
S'ense of Competence 

Operationally, the term "sense of competence'' is our short-hand JLabel 
for two related' variables, each of wtilch has considerable precedent in 4he 
literature: evaluation anxiety and achievement attributions . There is point 
and purpose^in considering the effects of each separately on testing behavior 
and I will explain why shortly.* However, t];ipre is also point and purpose 
in 'considering these two variables^ in relationship tp^^'each other^i perhaps 
ultimately reducing them, to one essential construct. That too will be pursued — 
briefly in this paper, but wtth considerable^intensity in the project itself. 
In any case, a cursory review of how these variables may a^ect achievement 
behavior, .including particularly performance In testing situations, is in order. 

Achievement A ttributions. Attributional analyses of archievement behavior 
are currently very popular (cf. Zuckcrmaa, J[979). Hriofly summarized, such 



analyses stress the importance of the individual's perception of the reasons 
for success or failure in the performance of a. task. Following the work of 
Bernard Weiner (cf . for example, 1977) it is generally assum^. that in 
an achieving situation the person characteristically attributes perceived 
success or failure to one of four factors: ability, effort, task difficulty, 
or luck. Parenthetically, the attributional, possibilities are likely much more 
diverse than that (cf. Falbo^ & Beck, 1979), but the. important point is that 
different attributions are like^ly to be associated with quite different 
motivational patterns. In particular, therp is extensive information that 

ability attributions may be especially important in this regard. Thus, for 

* — 

example, the person who attributes success^ to ability and failure to an external 
factor such as bad luck, is likely to exhibit quite different achievement 
patterns than someojie who feels that failure is due to his or her own lack of 
ability. Overall, individuals should be more attracted to ^nnd less fearful 
about situations in which they believe that their competence can>and will be 
demonstrated (cf. Kukla, 1978; Maehr & Nlcholls, in press). One would expect, 
then, that testing situations would be a4: tractive to (cf, Fyans & Maehr., in 
press) individuals who essentially believe that they have. a good chance of doing 
well. These situations allow them to demonstrate their competence at a . 
challenging task, thereby enhancing their sense of competence. Conversely, 
individuals who essentially state their lack of confidence by attributing failure 
in school-related tasks to lack of ability and success to luck are not so 
likely to relate positively to the testing situation. In otheV words, students^, 
who do not believe in their ability to succeed at sc^hool task^ will orient to 
such tasks in a way that they simply wl]l not demonstrate the best they can 
do. Moreover, and this Is our special Interest, such "achievement inliibi t ions'* 



are possibly most severely demotistrated in the standard testing situation. 
All the reservations about one's ability to perform well on school tasks are 
likely brought to a central focus in this special kind of situation^ 

Evaluation^ Anyiety is a construct with a long and productive history in 
psychology (see for example. Hill, 1972; in press). Generally, certain individual 
are found to have developed a fear of being evaluated, perhaps a fear of failure 
(cf. Hermans , .terLaack, & Maes, 1972; Atkinson & Raynor , 197A) , which causes 
them t6 avoid achieving situations or (when forced into them) to perform 
maladaptlvely. In the present project, evaluation anxiety (and s4:andard measures 
,for indexing it) will be considered first of aLl as an indicator of negative 
emotions toward achievement which eventuate in. the tendency to exhibit deta- * 
riorated performance and generally maladapt^ive behavior under testing conditions 
(cf. Hill, 1977; Hill & Eaton, 1977)., It is, or may be viewed, as ah emotional 
reaction which parallels attribut irfO'^s omid is similarly predictive of variation 
in achievement behavior. Essentially, evaluation anxiety should complement and 
enhance achievement attributions in predicting achi^evement behavior. Indeed, 
as one examines .the items that are used to elicit achievement attribution and 
identify evaluation anxiety^ an underlying common theme is evident. As I have 
already suggested, ^oth constructs appear to tap what might be termeti a "sense 

0 

of competence." When a student says that when he succeeds in school he 
typically does this because he Is smart, he is expressing his belief in his 
competence. Similarly, children who worry about how they wlLl respond on.^te3ts 
are likely expressing the feeling that they are lacking in* competence I In 
other words, the two indices may be getting, at l\w same thln}\ in .slightly 
different ways or at different facets of the same thing. On n priori grounds 
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this seems possible enough, byt an empirical explcTration of the coinmonalities 
of attribution and evaluation anxiety need to be examined. Perhaps two construct 
systems can be reduced to one. Perhaps one variable is dependent on the other. 
Thus, it may be best to consider "sense of competence" as the critical mediating 
motivational variable. But that is a possibility to be pursued, not a fact 
to be asserted. The point is th^t this possibility will be pursued as 'the' 
shared varianfce o-f achievement attributions and evaluation anxiety will be 
considered and analyzed. 
Achievement Goals 

Causal attributions, evaluation anxiety, sense of CQmpete,nce, and continuing 
motivation have all been assessed in the early phases of the project and their 
interrelationships will be reported later In this symposium. Not part of the 
data set as ye\ is another variable, one that we are Increasingly viewing as 
critical: the goals held by the student in reference to the achieving situation. 
Whatever effects an individual's sense of competence may have, it will most 
likely have these dependent on the goals* that the individual happens to hold 
for the achieving situation in question. If a student holds the goal of 
demonstrating to himself and others that he is competent in math his per- 
formance on a math test is likely to be differjint from someone who has no 
such goal, r The importance of considering goals'can be illustrated from several 
different literatures (see for example, Maehr & Nicholls, in press) but is so 
much in accord with common sense that it is unnecessary ; to dq so. Self- 
evidently, Individuals of different ethnic background likely hold different' 
achievement goals in what seem to be similar achievement tasks. Similarly, 
it seems that giyls and boys approach school ^tasks with quite different goals. 
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As Maehr and Nicholls argue, girls, see'm to be inor6 concerned to demonstrate 
that they are "well in tentloned, " they strive to show that they ^ave tried hard* 
Boys, on the other hand are more likely to endeavor to appear competent • B,ut 
in any case the "bottom line" is that any^ comprehensive analysis of achievement/ 
behavior can hardly ignore the fact of goal variation. The problem is one of ' 
gox)d theory and adequate measurement. . As of this point, we can only stress the 
importance of this variable, reference a first step in theory building (cf. ^ 
M^ehr & Nicholls, in press) and promise that the technology is being developed. 
^- Conclusion . * ' / 

Thus far I have outlined the'generfil rationale and essential thrust of the^ 
project. Befote concluding, it is well that I relate what I have said to the ' 
more specific concerns to be discussed by my colleagues, Wyans and Hills At 
this stage two questions are inevitably paramount: (1) Do these mediators in 
fact appear to play the hypothesized, mediator role in testing situations? 
(2) i^suming they do, ds there anything that we can d^^^l'^byt it? Dr. Fyans will 
deal'with the former question and Dr. Hill with the latter one but allow me*, 
a brief preliminary comment about eacfi in anticipation. 
Do Achieving Orientations Affect Test Performance ? 

^ Our answer to that question, of course, is "yes," In fact, our a^j^wer 
involves a more complicated, hypothetical causal sequence such as set forth 
in Figure 2. While the predictions implicit here are rather straightforward, 
perhaps self-evident, certainly not surprising, they may, nevertheless deserve 
a coimnent or ^ two. , 
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First, it is hypothesized that sociocultural background h^ direct affects' 
on both motivation and performance. ' Moreover, , it is hypothesized that the 
motivational effects serve to reinforce or enhance the' effects of sociocultural 
background on performance. Thus, children f ronPfcertain sociocult'ural back- 
grounds may be limited in skills relative to their peers in a given classroom. 
Not having thesje skills h^s motivational as well as performance effects. It -is 

ft 

not> only that their performance will likely be at a certain level in objective 

terms; that performance will cjharacteristically be interpreted by a significant * 

Other, such , as a teacher, and this interpretation of course is critical in 

motivational development. Not only would this interpretation involve success-* 

failure feedback, it would a.lso likely involve causr^l attributions; sugge;5tions 

to the child that he or she succeeded because they were smart or failed because 

they were dumb. Moreover the organization of the classroom may encourage ^ 

invidious comparisons ^ 

In sum, it is not only objective performance per se that will affect 

motivation but the interpretation of that performance. Additionally, one may 

♦ ♦ 

note that such "intferpretatiotis" , are, quite px)ssibly determined , by stereotypical 

.expectations of teachers for children of certain sociocultural backgrounds. . Thus 

there is some reason to believe that some teachers may have certain expec tationa 

for children based on their knowledge of their background quite apart from any 

objective assessment ^of their capacity per Se (cf . Rubovits & Maehr, 1971, 1973). 

In any case, all of this serves to emphasize that cognitive interpretat ions of 

^performance become increasingly important as the. child performs in school. 

Similarly, the aspect .associated 'with such Interpretations^ such as the fear of., 

being evaluated, ac^tually c^merges as an important*^phenomenon which enhances or 

{ ' . ^ 

inhibits test' performance . Thus, at some point one may expect "achieving 
orientations" to serve as mediating variables in the re 1 nl lonshi [) between 



sociocultur^l^background and performanc^. Finally , although it is not clearly 




express^ in Figure 2, ^.t :jLs obvlQ5|^f44igt the mediating role of motivational ^* 
factors should. Increase with gradje level. 

That in brief is ;a first and major concern of the projects It is one that. 

will be. el^iboratfed on by Dr. Fyans. - 

„ ■ ■ .. ' . ' ' ' " 

* Can Motivational Bias in Testing be Reduced ? 

Not surprisingly, our answer to. that question is'' likewise' "yes J' To give 
such an answer it is necessary to examine the special^ and unusual nature of the 
testing situation, to see why it might exacerbkte any negative orlen^tations ^ 
toward achievement and then determine whether it is possible to intervene . 
either by changing the person or' the situation. Professor Hill .will elaborate 
on this point further and report his research devoted to these particular issues. 

A Concluding Unscientific Postscript # 
Finally, 1 cannot resist, a word about the wider implications of this general 

i area of study. Few areas of research seem more natural or inevitable th^n the 

area of culture and Achievement \notivation. Talk to any*|teacher who musf deal 

with children of diverse sociocultural background and it is motivation that is 

their prime concern. Most of us are aware of. the dramatic wx)rk 15 or 20. years 

iago by McClelland' (c . g. , 1961) anc^ others (see, for example, Rosen, 1959) . Indeed,' 

that is the work that is most often cited — not always approvingly. However, - 

it is surprisingly difficult to find contemporary examples of cvilture, and 

* * ' ' 
motivation research. In particular, it is surprising that amidst *an Increasing 

coricern with ethnicity a\\d subcultural patterns in^ the- U.S. there is so little' 

research or^ culture and achievement motivation, Orie rpnson may be tlie paucity 

of good theory; another may be the vinadequacy rff jnethodology , Tlie jjresent, ^ 

symposium does not presume to lay the multlvaried probltMiis In ihUi regaixl to 

fest. What we do intend to do is present an Initial re-annlysis and prelimindry 
%■ • . ' ' ' 



data which may ultimately serve a^s a basis for-uenewed wdrk on culture and 
ftcbievement motivation, Moreover ^ we do not apologlzq^ for focusing^ first on j^' 
the standardized testying situation.. .That is a socially Important situation— 
perhaps more so **than it, should be. Moreover., it is a situation in which what 
we term '^motivational, biases" are likely tt) be most readily observed. Testing 
cannot be the end of culture and motivation 'Iresearchwbut it^serve3 &s an interesting 
beginning* / * • 
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Type of Variables Assessed in the tOR/lAuC Project 
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Sociocultural 


Developmental 


Contextual 


Achieving Orientations 




Achievement ftehavior 


Parent's Edacatiion 


Age/Grade 
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Time Pressure 


Causal Attributions 
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/ fivali^ation' Anxiehy 

/ ' ' 

/ /Senee of Competence 




T^4st Performance 


Ethnicity 

Size of Community/ 
• School 
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Social Compar- 
isons 

Multicultural 
Program 
Emphasis 




Continuing Motivation 

. Interests /Attitudes 

Overall Clasj^room 
Performance 
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ORIGINS OF ACHIEVING ORIENTATIONS 



Socitocultural Factots 
Developmental Factofrs 
Contextual Factors' 



•ACHIEVING ORIENTATIONS 



SENSE OF COMPETENCE: 



1* Causal Attributions 



2. Evaluation Anxiety 



ACHIEVEMENT: GOAI.S 



•ACHIEVEMENT BEHAVIOR 



TEST PERFORMANCE 



Also, Interests /con- 
tinuing motivation as 
jWell as school * 
perf ortnance generally 



Figure 1, A schematic drawing of the general oausal sequence 
envisioned in the lOE/UlUC ptoject 



Soclocultural 
Background 



Initial/Early 
School Performance 



1 • Achievement 
Attributions 

2. Evaluation 
Anxiety 



"Continuing Motivation" 

* 

Interests-Choosing to 
Approach School Tasks 



Later School and 



Test Performance 



Figure 2: Path Diagram of Hypothesized Relationships B^twefen Variables in the HEP Survey 
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